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Abstract 

We consider an illiquid financial market with different regimes modeled by a conti- 
nuous-time finite-state Markov chain. The investor can trade a stock only at the discrete 
arrival times of a Cox process with intensity depending on the market regime. Moreover, 
the risky asset price is subject to liquidity shocks, which change its rate of return and 
volatility, and induce jumps on its dynamics. In this setting, we study the problem 
of an economic agent optimizing her expected utility from consumption under a non- 
_o- ■ bankruptcy constraint. By using the dynamic programming method, we provide the 

j. * characterization of the value function of this stochastic control problem in terms of 

f~*) " the unique viscosity solution to a system of integro-partial differential equations. We 

next focus on the popular case of CRRA utility functions, for which we can prove 
smoothness C 2 results for the value function. As an important byproduct, this allows 
us to get the existence of optimal investment/consumption strategics characterized in 
K> . feedback forms. We analyze a convergent numerical scheme for the resolution to our 

stochastic control problem, and we illustrate finally with some numerical experiments 
the effects of liquidity regimes in the investor's optimal decision. 
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1 Introduction 

A classical assumption in the theory of optimal portfolio/consumption choice as in Merton 
|16j is that assets are continuously tradable by agents. This is not always realistic in 
practice, and illiquid markets provide a prime example. Indeed, an important aspect of 
market liquidity is the time restriction on assets trading: investors cannot buy and sell them 
immediately, and have to wait some time before being able to unwind a position in some 
financial assets. In the past years, there was a significant strand of literature addressing 
these liquidity constraints. In [19], [15], the price process is observed continuously but the 
trades succeed only at the jump times of a Poisson process. Recently, the papers [IT], [I], [8] 
relax the continuous-time price observation by considering that asset is observed only at the 
random trading times. In all these cited papers, the intensity of trading times is constant or 
deterministic. However, the market liquidity is also affected by long-term macroeconomic 
conditions, for example by financial crisis or political turmoil, and so the level of trading 
activity measured by its intensity should vary randomly over time. Moreover, liquidity 
breakdowns would typically induce drops on the stock price in addition to changes in its 
rate of return and volatility. 

In this paper, we investigate the effects of such liquidity features on the optimal portfolio 
choice. We model the index of market liquidity as an observable continuous-time Markov 
chain with finite-state regimes, which is consistent with some cyclically observed in finan- 
cial markets. The modelisation of financial stock prices by regime-switching processes was 
originally proposed and justified in [9], and since then this approach has been extensively 
pursued in the financial litterature, see e.g. [I], |20] and the references therein. 

The economic agent can trade only at the discrete arrival times of a Cox process with 
intensity depending on the market regimes. Moreover, the risky asset price is subject to 
liquidity shocks, which switch its rate of return and volatility, while inducing jumps on 
its dynamics. In this hybrid jump-diffusion setting with regime switching, we study the 
optimal investment/consumption problem over an infinite horizon under a nonbankruptcy 
state constraint. We first prove carefully that dynamic programming principle (DPP) holds 
in our framework. Due to the state constraints in two dimensions, we have to slightly weaken 
the standard continuity assumption, see Remark 13.11 Then, using DPP, we characterize 
the value function of this stochastic control problem as the unique constrained viscosity 
solution to a system of integro-partial differential equations. In the particular case of 
CRRA utility function, we can go beyond the viscosity properties, and prove C 2 regularity 
results for the value function in the interior of the domain. As a consequence, we show 
the existence of optimal strategies expressed in feedback form in terms of the derivatives 
of the value function. Due to the presence of state constraints, the value function is not 
smooth at the boundary, and so the verification theorem cannot be proved with the classical 
arguments of Dynkin's formula. To overcome this technical problem, we use an ad hoc 
approximation procedure (see Proposition 15. 2p . We also provide a convergent numerical 
scheme for solving the system of equations characterizing our control problem, and we 
illustrate with some numerical results the effect of liquidity regimes in the agent's optimal 
investment/consumption. We also measure the impact of continuous time observation with 



respect to a discrete time observation of the stock prices. Our paper contributes and 
extends the existing literature in several ways. First, we extend the papers [19] and [15] by 
considering stochastic intensity trading times and regime switching in the asset prices. For 
a two-state Markov chain modulating the market liquidity, and in the limiting case where 
the intensity in one regime goes to infinity, while the other one goes to zero, we recover the 
setup of [3] and [2] where an investor can trade continuously in the perfectly liquid regime 
but faces a threat of trading interruptions during a period of market freeze. On the other 
hand, regime switching models in optimal investment problems was already used in [23], 
|20| or [21] for continuous-time trading. 

The rest of the paper is structured as follows. Section 2 describes our continuous-time 
market model with regime-switching liquidity, and formulates the optimization problem 
for the investor. In Section 3 we state some useful properties of the value function of our 
stochastic control problem. Section 4 is devoted to the analytic characterization of the 
value function as the unique viscosity solution to the dynamic programming equation. The 
special case of CRRA utility functions is studied in Section 5: we show smoothness results 
for the value functions, and obtain the existence of optimal strategies via a verification 
theorem. Some numerical illustrations complete this last section. Finally two appendices 
are devoted to the proof of two technical results: the dynamic programming principle, and 
the existence and uniqueness of viscosity solutions. 

2 A market model with regime-switching liquidity 

Let us fix a probability space (Q, J 7 , P) equipped with a filtration F = {J-t)t>o satisfying 
the usual conditions. It is assumed that all random variables and stochastic processes are 
defined on the stochastic basis (fi, J 7 , F, P). 

Let I be a continuous-time Markov chain valued in the finite state space 1^ = {1, . . . , d}, 
with intensity matrix Q = (qij). For i 7^ j in Id, we can associate to the jump process /, 
a Poisson process N 13 with intensity rate q^ > 0, such that a switch from state i to j 
corresponds to a jump of N lJ when I is in state i. We interpret the process I as a proxy 
for market liquidity with states (or regimes) representing the level of liquidity activity, in 
the sense that the intensity of trading times varies with the regime value. This is modeled 
through a Cox process (Nt)t>o with intensity (Xi t )t>o, where Aj > for each i € Id ■ For 
example, if Aj < Aj, this means that trading times occur more often in regime j than in 
regime i. The increasing sequence of jump times (r n ) n >o, to = 0, associated to the counting 
process TV represents the random times when an investor can trade a risky asset of price 
process S. Note that under these assumptions the jumps of I and N are a.s. disjoint. 

In the liquidity regime It = i, the stock price follows the dynamics 

dS t = Stibidt + aidWt), 

where W is a standard Brownian motion independent of (I, N), and bi € R, cij > 0, for i € 
Id- Moreover, at the times of transition from I t - = i to It = j, the stock changes as follows: 

S t = S t -{1 -Hj) 



for a given 7^ € (—00, 1), so the stock price remains strictly positive, and we may have a 
relative loss (if 7^ > 0), or gain (if 7^ < 0). Typically, there is a drop of the stock price 
after a liquidity breakdown, i.e. 7^ > for Xj < Aj. Overall, the risky asset is governed by 
a regime-switching jump-diffusion model: 

dS t = St-fb^dt + a^dWt-j^^dN^-' 1 ^. (2.1) 

Portfolio dynamics under liquidity constraint. We consider an agent investing and con- 
suming in this regime-switching market. We denote by (Yt) the total amount invested 
in the stock, and by (cj) the consumption rate per unit of time, which is a nonnegative 
adapted process. Since the number of shares Y t / St in the stock held by the investor has to 
be kept constant between two trading dates T n and r n +i, then between such trading times, 
the process Y follows the dynamics: 

dY t = Y t -—, T n < t < r n+ i, n > 0, 

The trading strategy is represented by a predictable process (Ct) such that at a trading 
time t = r n+ i, the rebalancing on the number of shares induces a jump Q in the amount 
invested in the stock : 

AF t = (t- 

Overall, the cadlag process Y is governed by the hybrid controlled jump-diffusion process 

dY t = Yt-fb^dt + o-^dWt-^^dN^-^+CtdNt. (2.2) 

Assuming for simplicity a constant savings account (see Remark l2.2p . i.e. zero interest rate, 
the amount (Xt) invested in cash then follows 

dX t = -ctdt-QdNf (2.3) 

The total wealth is defined at any time t > 0, by Rt = Xt + Yt, and we shall require the 
non-bankruptcy constraint at any trading time: 

R Tn > 0, a.s. Vn > 0. (2.4) 

Actually since the asset price may become arbitrarily large or small between two trading 
dates, this non-bankruptcy constraint means a no-short sale constraint on both the stock 
and savings account, as showed by the following Lemma. 



Lemma 2.1 The nonbankruptcy constraint {2-1$ is formulated equivalently in the no-short 
sale constraint: 

X t > 0, and Y t > 0, Vt > 0. (2.5) 

This is also written equivalently in terms of the controls as: 

-Y t - < (t < X t -, t>0, (2.6) 

'•Tn + l 

c s ds < X t , r n <t < r n+1 , n > 0. (2.7) 



Proof. By writing by induction the wealth at any trading time as 



R r n+ i 



Rr n + Y Tn 



s. 



Tn+1 



i 



T"n+1 



Cfdt, n > 0, 



and since (conditionally on J> n ) the stock price S Tn+1 has support in (0, oo), we see that 
the nonbankruptcy condition R Tn+1 > is equivalent to a no-short sale constraint: 



< Y Tn < R Tn , n>0, 
together with the condition on the nonnegative consumption rate 

1 c t dt < R Tn -Y Tn =X Tn , n>0. 



(2.8) 



(2.9) 



Since Y Tn = Y Tn - + Ct„; and since R Tn = R Tn - a -S-j the no-short sale constraint (|2.8|) means 
equivalently that (|2.6|) is satisfied for t = r n . Since (, is predictable, this is equivalent to 
(j2.6|) being satisfied dP<S>dt almost everywhere. Indeed, letting H t = liv <_y_ or f > x \i 



T,r n <t H T 



E 



f*H s \ Is ds 



and we deduce that 



H is predictable, so that Vi > 0, = E 
H t = dP <g> dt a.e. since A/ t > 0. 

Moreover, since X t = X Tn — f T c s ds for r n < t < r n +i, the condition (|2.9p is equivalent 
to (|2"77]) . By rewriting the conditions (US])- ((22]) as 

^ > 0, X Tn > 0, X (Tn+l) _ > 0, Vn > 0, 

and observing that for T n < t < T n +i, 



Y t 



S; 






S. 



we see that they are equivalent to (|2.5p . 



D 



Remark 2.1 Under the nonbankruptcy (or no-short sale constraint), the wealth (Rt)t>o 
is nonnegative, and follows the dynamics: 



dRt 



R t - Z t - ( b h _ dt + a h _ dW t - 7, _ , lt dN t 



i,-, it 



c t dt, 



(2.10) 



where Zt := -^ valued in [0, 1] is the proportion of wealth invested in the risky asset; and 
evolves according to the dynamics: 



dZ t 



Z t -(1- Z t - ) [ {b It _ - Z t - a\_ ) dt + a It _ dW t - j 
Ct 



V* 



Zt-li 



-dN^- h 



Q 



diV t + Z t _ — 



■dt, 



(2.11) 



for t < r = inf{t > : R t = 0}. 



Given an initial state (i,x,y) € Id X M + x K + , we shall denote by Ai(x,y) the set of 
investment /consumption control process (£, c) such that the corresponding process {X, Y) 
solution to (|2.2p - (|2.3p with a liquidity regime I, and starting from (J - , X - , Y Q - ) = (i, x, y), 
satisfy the non-bankruptcy constraint f|2.5[) (or equivalently (|2.6p - (|2.7p ). 

Optimal investment/ consumption problem. The preferences of the agent are described 
by a utility function U which is increasing, concave, C 1 on (0, oo) with U(0) = 0, and 
satisfies the usual Inada conditions: U'(Q) = oo, U'(oo) = 0. We assume the following 
growth condition on U : there exist some positive constant K, and p £ (0, 1) s.t. 

U{x) < Kx p , x>0. (2.12) 

We denote by U the convex conjugate of U, defined from M. into [0, oo] by: 

U{£) = sup[U{x) - x£], 

which satisfies under (|2.12p the dual growth condition on R + : 

U(£) < K£- p , W > 0, with p = -^— > 0, (2.13) 

1 — p 

for some positive constant K. 

The agent's objective is to maximize over portfolio/consumption strategies in the above 
illiquid market model the expected utility from consumption rate over an infinite horizon. 
We then consider, for each i G 1^, the value function 



Vi(x,y) = sup E 

(C,c)eAi(x,y) 



oo 

e- pt U(ct)dt 



(x,y)£R 2 + , (2.14) 



/o 
where p is a discount factor. We also introduce, for % € 1^, the function 

Vi{r) = sup Vi(x,r — x), r > 0, (2-15) 

x6[0,r] 

which represents the maximal utility performance that the agent can achieve starting from 
an initial nonnegative wealth r and from the regime i. More generally, for any locally 
bounded function Wi on M^_, we associate the function Wi defined on M + by: u)j(r) = 
sup xe r Q r iWi(x,y), so that: 

Wi(x + y) = sup Wi(x - e,y + e), (x,y) <E~R+. 

In the sequel, we shall often identify a d-tuple function (wi)i e i d defined on M^_ with the 
function w defined on K+ x 1^ by w(x,y,i) = Wi(x,y). 

In this paper, we focus on the analytic characterization of the value functions Vi (and 
so Vi), i E Id, and on their numerical approximation. 

Remark 2.2 For simplicity we have assumed zero interest rate for the riskless asset. The 
case of constant r ^ can actually be reduced to this case, at the cost of allowing time- 
dependent utility of consumption. This can be seen from the identity 

/"OO /'OO 

E / e~ ps U{c s )ds = E / e - ps U(s, c s )ds, 
Jo Jo 



where p = p — pr, c s = e rs c s and U(s, c) = e prs U(e rs c). Note that U(s, •) still satisfies 
(|2.12p . and in the special case of power utility U{c) = c p , one actually has U(s, •) = U. I 



3 Some properties of the value function 

We state some preliminary properties of the value functions that will be used in the next 
section for the PDE characterization. We first need to check that the value functions are 
well-defined and finite. Let us consider for any p > 0, the positive constant: 

2 



k(p) := max phz - -±p(l - p)z 2 + V g^((l - zjijf - 1) 



< CO. 



iel d ,«6[o,i] 

.7 A 

We then have the following lemma. 

Lemma 3.1 Fix some initial conditions (i,x,y) Gl^x R + x R + , and some p > 0. Then: 

(1) For any admissible control (C; c ) S ^(^y) associated with wealth process R, the 
process (e~ ^*-Rf)t>o *s a supermartingale. So, in particular, for p > A;(p), 

lim e - p *E[i^l = 0. (3.1) 

(2) For fixed T 6 (0, oo), i/te family (^xa t )t,C,c * s uniformly integrable, when r ranges 
over all stopping times, and (C, c) runs over Ai(x,y). 

Proof. (1) By Ito's formula and ()2.10p . we have 
d{e~ k ^ t R P ) = -k{p)e- k ^ t R p t dt + e~ k ^ t d(R p ) 



e -k(p)t 



k(p)R P + P R P : 1 (- Ci + b It _Rt-z t j) + £^_Jlufr 2 ( - Jt _u t _z t . 



2 
(it + dM u 



where M is a local martingale. Now, by definition of k(p), we have 
pR P Z l (-Q + b h _R t -Z t J) + V -^-^R P z\o h _R^Z t ^f 

+ J2vh-ARUi-ii t -iZt-) p -R?-) < -pctRt 1 + Hp)Rf- 

frh- 

< k(p)R p ^. 

Since R has countable jumps, Rt = Rt-, dF <8> dt a.e., and so the drift term in d(e~ k ^ p ' t R P ) 
is nonpositive. Hence (e~ k ^ p i l R P ) t>0 is a local supermartingale, and since it is nonnegative, 
it is a true supermartingale by Fatou's lemma. In particular, we have 

< e- pt E[R%] < e-( p - k{p))t {x + y) p (3.2) 

which shows (13.11). 



(2) For any q > 1, we get by the supermartingale property of the process (e k ( pq ' t R Pq )t>o 
and the optional sampling theorem: 

E [( i? TAr)1 < e k ^ T {x + y) m < oo, V(C,c) e A (x,y), r stopping time, 
which proves the required uniform integrability. □ 

The next proposition states a comparison result, and, as a byproduct, a growth condition 
for the value function. 

Proposition 3.1 

(1) Let w = (wi)i£i d be a d-tuple of nonnegative functions on ]R^_, twice differentiable on 
M^\{(0,0)} such that 



pwi -biy 



dwi 1 2 2^ 2w i 

~dy~~2 aiy ~iW 



J2<Hj[ w j( x iy( l -Jij)) ~Wi{x,y)] 



Xi[wi(x + y) -Wi(x,y)] - U 



dug 
O.r 



> 0, (3.3) 



for all i G Id, (x, y) € R\ \ {(0,0)}. Then, for all i € I d , V\ < w i; on M+. 

(2) Under (|2.12p . suppose that p > k(p). Then, there exists some positive constant C s.t. 

v l (x,y) < C(x + y)P, V(i,x,y) € I d x R 2 + . (3.4) 

Proof. (1) First notice that for (x,y) = (0,0), the only admissible control in Ai(x,y) 
is the zero control C = 0, c = 0, so that Uj(0,0) = 0. Now, fix (x,y) £l}\ {(0,0)}, i 
€ Id, and consider an arbitrary admissible control ((,c) £ Ai(x,y). By Ito's formula to 
e-^wiXuYtJt), we get: 



d[e- pt w(Xt,Y t ,I t )} 



-nt\ 9w . ^ r dw 1 2 ^ r2 d 2 w 

+ £>, 3 [w{X t -,Y t -(l- ll ] ),j)-w(X t -,Y t -,I t -)] 

+ a v [w(x t - - g, y t - + Ct, i t -) - AX t - , Y t - , J t - )] ] dt 

+ e ~pt a j Yt -^(X t -,Y t -,I t -)dW t 
t dy 

+e~ pt Y, MX t -,Y t -(l- llt _.),j)-w(X t -,Y t -,I t -)](dN I ^-q It _.dt) 
i+h- 

+e~' }t [w(X t - -Ct,Y t -+C t ,I t -)-w(X t -,Y t -,I t -)]](dN t -X It _dt). (3.5) 

Denote by r = inf{£ > : (X t ,Y t ) = (0, 0)}, and consider the sequence of bounded stopping 
times T n = inf{£ > : Xt + Yt > n or Xt + Yt < 1/n} A n, n > 1. Then, r n /*• r a.s. when 
n goes to infinity, and ct = 0, X t = Yt = for t > t, and so 



E 



- pt U{c t )dt 



E 



e~ pt U{c t )dt 



(3.6) 



From Ito's formula (|3.5|) between time t = and t = r n , and observing that the integrands 
of the local martingale parts are bounded for t < r n , we obtain after taking expectation: 



w(x,y,i) 



E 



-pTr, 



w(X Tn ,Y Tn J Tn ) 



Jo 



dw 



dw 



2 



w 



upw+c ^- b ^-^-rl Y ^w 



- J2 % 3 [w{X t -,Y t -{l- llt j ),j)-w(X t -,Y t -,I t -)} 
-\ _ [w(X t - - C t , Y t - + Ct, I t - ) - w(X t - , Y t - , I t - )] ) dt 



> E 



~pT n 



w(X Tn ,Y Tn J Tn ) + 



- pt U{c t )dt 



> E 



- pt U(c t )dt 



where we used (|3.3p . and the nonnegativity of w. By sending n to infinity with Fatou's 
lemma, and (|3.6p . we obtain the required inequality: W{ > Vj since (c, £) are arbitrary. 

(2) Consider the function Wi(x,y) = C(x + y) p . Then, for (x, y) € M+ \ {(0,0)}, and 
denoting by z = y/(x + y) £ [0, 1], a straightforward calculation shows that 



pwi - biy 



dwj 
dy 



1 o q9 2 W, 



-22' 



2^ cV 



1 ~ X^iK'^yt 1 - Tii)) - «>i(x,y)] 



~ 01D' 

Xi[wi{x + y) -Wi(x,y)] - ^("rp) 



07 



C(x + y)P [p - pb lZ + ^-p(l - p)z 2 - £ fti ((l - ^) P - I) 



U((z + y) p ~'pC) 



(3.7) 



by (|2.13p . Hence, for p > k(p), and for C sufficiently large, the r.h.s. of (|3.7p is nonnegative, 
and we conclude by using the comparison result in assertion 1). □ 

In the sequel, we shall assume the standing condition that p > k(p) so that the value 
functions are well-defined and satisfy the growth condition (|3.4p . We now prove continuity 
properties of the value functions. 

Proposition 3.2 The value functions Vi, i £ 1^, are concave, nondecreasing in both vari- 
ables, and continuous on R+. This implies also that V{, i € Id, are nondecreasing, concave 
and continuous on R + . Moreover, we have the boundary conditions for Vi, i E Lj, on 
{0} x R + : 



Vi(0,y) 



0. 



E 



-pr\ 



\ h fo%9 



if y = o 

if y > 0. 



(3. 



Here P denotes the continuous-time Markov chain I starting from i at time 0. 



Proof. Fix some (x, y, i) £ R? x 1^, 5\ > 0, 62 > 0, and take an admissible control (£, c) 
£ Ai(x, y). Denote by R and R' the wealth processes associated to (C,c), starting from 



initial state (x,y,i) and [x + S\,y + 62,1)- We thus have R' = R + 81 + 82S/ So- This 
implies that (Ci c ) is a ^ so an admissible control for (x + <5i , y + $2 , i), which shows clearly the 
nondecreasing monotonicity of Vi in x and y, and thus also the nondecreasing monotonicity 
of Vi by its very definition. 

The concavity of Vi in (x, y) follows from the linearity of the admissibility constraints in 
X, Y, £, c, and the concavity of U. This also implies the concavity of Vi{r) by its definition. 

Since V{ is concave, it is continuous on the interior of its domain M.+ . From (|3.4p . and 
since vi is nonnegative, we see that Vi is continuous on (xo,yo) = (0,0) with Uj(0,0) = 0. 
Then, in is continuous on M + with £>i(0) = 0. It remains to prove the continuity of Vi at 
( x o,Do) when xo = or yo = 0. We shall rely on the following implication of the dynamic 
programming principle 



Vi(x,y) 



sup E 
ceC(x) 

sup E 
ceC(x) 



e- pt U(c t )dt + e- pT1 v . (R T 
e~ pt U(c t )dt + e- pT1 Vii (x - 



c t dt + y 



So" 



(3.9) 



V(x,y) e 



^ 



where C(x) denotes the set of nonnegative adapted processes (ct) s.t. j^ 1 ctdt < x a.s. 
(i) We first consider the case xo = (and yo > 0). 

In this case, the constraint on consumption c in C(xq) means that q = 0, t < t\, so 
that (|3.9I) implies (|3.8|) . Now, since Vi is nondecreasing in x, we have: Vi(x,y) > Vi(0,y). 
Moreover, by concavity and thus continuity of Vi(0, .), we have: lim y _>. yo u«(0, y) = t>j(0, yo). 
This implies that liminf^^^^.j/o) v i( x iV) — v «(0, yo)- The proof of the converse inequality 
requires more technical arguments. For any x,y > 0, we have: 



Vi(x,y) 



= sup E 
ceC(x) 

< sup E 

cec(x) 

= : E 1 (x)+E 2 (x,y). 



e~ ps U(c s )ds + e- pTl v 



-ps 



U(c s )ds 



L Jo 



E 



e~ pTl v lT 



c s ds + y-p-) 
^0 



(3.10) 



Now, by Jensen's inequality, and since U is concave, we have: 



U{c s l {s < Tl} )pe- ps ds < U 



c.,1 



: s-L{ s <n}Pe 



"^ds 



and thus: 



-ps 



U(c s )ds < 



U{px) 



a.s. Vc G C(x) 



(3.11) 



by using the fact that JI 1 ctdt < x a.s. By continuity of ?7 in with U(0) = 0, this shows 
that E\{x) converges to zero when x goes to xo = 0. Next, by continuity of Vi, we have: 
v 4 (x + y^P-) — > v i (yoTp - ) a -S- when (x,y) — > (0, yo)- Let us check that this convergence 
is dominated. Indeed from (|3.4p . there is some positive constant C s.t. 



sv 



5 



V ( x + ^) ^ C(x + z/-^) p < C(x + yf IV 
r i Jo ^0 v 



5 ri \P 



So 



10 



Moreover, 
















E 


['-(%)' 


I,W 


/>oo 

= / Aj t e" 

Jo 


Io x is e -pt(^.) P dt < m ax A, f 

\<W i&d Jo 


and so 




E 


[>-"(%)' 


< 


/>oo 

max Aj / E 


-"(!)": 


(It 












< 


max Aj / e~ 

i&d Jo 


(p-k(p))t^ 


< OO 



r-( 



Sc 



dt. 



where we used in the second inequality the supermartingale property in Lemma 13.11 (and, 
more precisely, equation (|3.2p ) for x = 0,y = l,c = £ = 0. One can then apply 
the dominated convergence theorem to E2(x,y), to deduce that E2(x,y) converges to 
when (x,y) — > (0,yo). This, together with (|3,8p . (|3.10p . proves that 



E 



e_pT1 \ (yo^j 



So 



\imswp/ x \_^r \Vi(x,y) < Vi(0,yo), and thus the continuity of v i at (0, yo). 

(ii) We consider the case yo = (and xo > 0). 

Similarly, as in the first case, from the nondecreasing and continuity properties of Vi(.,0), 
we have: liminf/^w^o) Vi(x,y) > Vi(xo,0). Conversely, for any x > 0, and c G C(x), 
let us consider the stopping time t c = inf {t €> : J* c s <is = xo}. Then, the nonnegative 
adapted process c' defined by: c' t = q1 r i , lies obviously in C(xo)- Furthermore, 

n /-tcAti />n 

e- / ' s f/(c s )ds = / e-^C/^ds + / e"' ,s C/(c s )ds 

JO JtcAti 

< [* e^U(c' s )ds + ^fr- 3 *)*) , 
Jo P 



(3.12) 



by the same Jensen's arguments as in (|3.1ip . and for all y > 0, 



v - [ x 



S T 



ctdt + y-p- < v. [xo- c' t dt + (x - x )+ + y-p- 

JQ ' T i v Jo <->0 



S, 



< v ik (xo- J' d t dt) + v ih ((x - xo)+ + y^-) ,(3.13) 

where we have used the fact that Vi is nondecreasing, and subadditive (as a concave function 
with Vi(0) > 0). By adding the two inequalities (|3.12|) - ()3.13j) . and taking expectation, we 
obtain from (13.91): 



«,(*,„) < v t (xo,0) + Uipix - XoM + E 



-pr H 



[{x-x )+ + y-^- 

^0 



and by the same domination arguments as in the first case, this shows that 

limsup Vi(x,y) < Vi(x ,0), 
(x,y)->-(x ,0) 



which ends the proof. 



□ 
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Remark 3.1 The above proof of continuity of the value functions at the boundary by 
means of the dynamic programming principle is somehow different from other similar proofs 
that one can find e.g. in [6j \T7\ 123] . Indeed in such problems the proof of dynamic pro- 
gramming principle is done (or referred to) in two parts: the "easy" one (<) which does 
not require continuity of the value function, and the 'difficult" one (>) which requires the 
continuity of the value function up to the boundary. The proof of continuity at the bound- 
ary in such cases uses only the "easy" inequality. In our case, due to the specific boundary 
condition of our problem, the "easy" inequality is not enough to prove the continuity at 
the boundary. We need also the "hard" inequality. For this reason we give, in Appendix 
A, a proof of the dynamic programming principle in our case that, in the "hard" inequality 
part, uses the continuity of Vi in the interior and the continuity of its restriction to the 
boundary (which are both implied by the concavity and by the growth condition (j3~ 



Remark 3.2 For simplicity we have restricted our study to the case where U is defined 
on the positive half- line R + . With some work, our results can be extended to the case 
U(0) = — oo, assuming U(c) > —Kc g , for some K > 0, q < 0. In that case (assuming 
p > 0), Vi(x,y) > — oo whenever x > 0, y > 0, while Vi(0 + ,y) = — oo for all y. I 

We shall also need in Section [5] the following technical lemma. 

Lemma 3.2 There exists some positive constant C > s.t. 

dvi, + v ,. Vi(x + 5,y) -Vi(x,y) nTT>tn\ w r- to ■ r~ IT (11A\ 

— (x^,y) := lim > C U (2a;), V x, y 6 R + ,i € I d . (3.14) 

OX 810 

Proof. Fix some x,y > 0, and set x\ = x + 5 for 5 > 0. For any ((,c) € Ai(x,y) with 
associated cash/amount in shares (X, Y), notice that (£, c) := (C, c+<51[ 0)1Ari ]) is admissible 
for (x\,y). Indeed, the associated cash amount satisfies 

t-t 



X t = X t + ( Xl -x)- Sl [QMn] (s)ds > X t > 0, 

Jo 

while the amount in cash Y t = Y t > since ( is unchanged. Thus, ((,c) S Ai(x\,y), and 
we have 



Vi(xi,y) > E 

= E 



- pt U{c t )dt 
- pt U{c t )dt 



+ E 



lATl 



-" (U{ct + 6)- U(ct)) dt 



(3.15) 



Now, by concavity of U: U(c t + 5) - U(c t ) > 6U'(c t + 6), and 



1AT1 



e-P\U{c t + 5)-U( 



rl An 
c t ))dt > / e~ pt 5U'(c t + S)dt 
Jo 



> 8e- p{ - 1AT ^ 



lAn 



U'{ct + S)dt 

"lATl 



fl ATI 

> 8e-»( 1AT ^U'(2x + 5) l {ct<2x} dt. (3.16) 

Jo 
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Moreover, 



2x 



/ l{ct>2x}dt < / ctdt < X, 

Jo Jo 



since (C,c) is admissible for (x,y), so that 
•lA-n 



jf ' i {ct<2x} (it > (l a n ) - QatiJ >ii 



{n>l}- 



(3.17) 



By combining (I3.16h and <|3.1T|> . and taking the expectation, we get 



E 



lA-n 



e- pt (U(c t + 5)-U(c t ))dt 



> 5U'(2x + 5)E 



e o x {ti>1} 



By taking the supremum over (£, c) in (|3.15p . we thus obtain with the above inequality 



Uj(x + (5,y) > Vi(x,y) + 5U'(2x + 5)E 



c o x {n>i} 



Finally, by choosing C = E[e p ^1{ti>i}1 > 0> anc ^ letting 5 go to 0, we obtain the 

required inequality (|3.14p . □ 

4 Dynamic programming and viscosity characterization 

In this section, we provide an analytic characterization of the value functions i>i, i € Ed, 
to our control problem (|2.14p . by relying on the dynamic programming principle, which is 
shown to hold and formulated as: 

Proposition 4.1 (Dynamic programming principle) For all (x,y,i) € M+ X Id, and any 

stopping time t, we have 



Vi(x,y) 



Proof. See Appendix A. 



sup E 

(C,c)eA l (x,y) L Jo 



e~ pt U(c t )dt + e~ pT v lT (X T ,Y T ) 



(4.1) 



□ 



The associated dynamic programming system (also called Hamilton-Jacobi-Bellman or 
HJB system) for Vi, i £ Id, is written as 



dvi 1 2 2 d 2 Vi 



ox 



(4.2) 



^2 Qij [vj {x, y{\ - jij)) - Vi(x, y) 



j¥* 



Xi [vi(x + y) -Vi(x,y)] = 0, (x,y) € (0, oo) x R + , i G I d , 



together with the boundary condition (|3.8p on {0} x M + for v i, i 6 Id- Notice that, arguing 
as one does for the deduction of the HJB system above, the boundary condition (|3.8p may 
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also be written as: 

- ^2 Qij [vj (0, y(l - n/ij)) - Vi(0, y) 

-\i[vi{y)-Vi(0,y)] = 0, y > 0, i e I d . (4.3) 

~ fdvA 
Notice that in this boundary condition the term U I -7— ) has disappeared. This implicitly 

\ox J 

comes from the fact that, on the boundary x = the only admissible consumption rate is 
c = 0. We will say more on this in studying the case of CRRA utility function in Section 
5.1. 

In our context, the notion of viscosity solution to the non local second-order system (E) 
is defined as follows. 

Definition 4.1 (i) A d-tuple w = (uii)i^i d of continuous functions on K^_ is a viscosity 
supersolution (resp. subsolution) to (14, 2p if 

p<Pi(x,y)-biy-^(x,y) - -aff-^(x,y) - U (-^(x,y) 

- Y2 qi i \fj ( s > y^ 1 ~ 7 ^)) ~ ^^' & 

- Xi [<Pi(x + y) -ipi(x,y)] > (resp. <) 0, 

for all d-tuple ip = (</?j)j e i d of C 2 functions on M+, and any (x,y,i) S (0, 00) x R + x 1^, 
such that Wi(x,y) = ipi(x,y), and w > (resp. <) ip on M. 2 ^ x 1^. 

(ii) A d-tuple w = (wi)i£i d of continuous functions on ]R^_ is a viscosity solution to (14. 2D if 
it is both a viscosity supersolution and subsolution to ( 14.21) . 



The main result of this section is to provide an analytic characterization of the value 
functions in terms of viscosity solutions to the dynamic programming system. 

Theorem 4.1 The value function v = (vi)i£i d is the unique viscosity solution to (14.2P 
satisfying the boundary condition (I3.8p . and the growth condition (13. 4|) . 



Proof. The proof of viscosity property follows as usual from the dynamic programming 
principle. The uniqueness and comparison result for viscosity solutions is proved by rather 
standard arguments, up to some specificities related to the non local terms and state con- 
straints induced by our hybrid jump-diffusion control problem. We postponed the details 
in Appendix B. □ 

5 The case of CRRA utility 

In this section, we consider the case where the utility function is of CRRA type in the form: 

x p 
U(x) = — , x > 0, for some p € (0, 1). (5.1) 

P 
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We shall exploit the homogeneity property of the CRRA utility function, and go beyond the 
viscosity characterization of the value function in order to prove some regularity results, and 
provide an explicit characterization of the optimal control through a verification theorem. 
We next give a numerical analysis for computing the value functions and optimal strategies, 
and illustrate with some tests for measuring the impact of our illiquidity features. 

5.1 Regularity results and verification theorem 

For any (i,x,y) S I^x M+, (C, c) E A(x,y) with associated state process (X, Y), we notice 
from the dynamics (|2.3p - (|2.2p that for any k > 0, the state (kX, kY) is associated to the 
control (k(,kc). Thus, for k > 0,we have (C, c) € Ai(x,y) iff (kC,kc) G A(kx,kc), and so 
from the homogeneity property of the power utility function U in (|5.ip . we have: 

Vi (kx,ky) = k p Vi (x,y), V(i,s, y) € l d x R 2 + , k G R+. (5.2) 

Let us now consider the change of variables: 

(rE,y)G]R^\{(0,0)} — > (r = x + y,z = -%—) G (0,oc) X [0, 1]. 

x + y 

Then, from (|5.2p . we have Vi(x,y) = Vi(r(l — z),rz) = r p Vi(l — z,z), and we can separate 
the value function Vi into: 

Vi (x,y) = U(x + y)<pi(-¥—), V(i,x,y) G I d x « \ {(0,0)}) (5.3) 

where </?j(z) = p Vj(l — z,z) is a continuous function on [0, 1]. By substituting this trans- 
formation for m into the dynamic programming equation (|4.2p and the boundary condition 
(|4.3p . and after some straightforward calculations, we see that ip = {ipi)i^i d should solve 
the system of (nonlocal) ordinary differential equations (ODEs): 

(p - pkz + ip(l - p)a 2 z 2 ) l p i - (1 - p) (<pi - ^) "^ (5.4) 

- z(l - z)(k - z(l- P )a 2 H - \z\\ - zfoW> 



Yl OH [t 1 ~ z ^ P ^i\ i_zZ ) ~ ww 



j¥=i 



Xi sup [(pi(ir) - (fi(z)} = 0, ze[0, 1), iGla 

ttG[0,1] 



together with the boundary condition for z = 1: 



(p-phi + -p(l -p)o?)y>i(l) 



V"^[(l-7ij) p ^(l) -Vi(l)] - Aj sup [c^(tt) - tpi(l)] = 0, iel rf . (5.5) 
0+ i *e[o,i] 



The following boundary condition for z = 0, obtained formally by taking z = in (I5.4p . 

p^(0)-(l-p)(^(0))~^ 
~~ y^^i[Vj(°) -^i(°)] _ Aj sup [(^i(7r) - <pi(0)] = 0, ield, (5.6) 

& ^[0,1] 

is proved rigorously in the below Proposition. 
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Proposition 5.1 The d-tuple ip = (y>i)iei d is concave on [0,1], C 2 on (0,1). We further 
have 



(5.7) 

(5.8) 

(5.9) 

(5.10) 

oo, (5.11) 



and cp is the unique bounded classical solution of (|5.4|) on (0,1), with boundary conditions 

(ESD-dESD. 



lim zip\{z) 

z— >0 


= o, 


limzVi'(^) 


= o, 


lim(l-z)<^(z) 

Z—>1 


= o, 


lim(l-*)V(*) 

z— !>1 


= o, 


linW(z) 
z->l 


= — 



Proof. Since ip%{z) = p v%(l — z, z), and by concavity of Uj(., .) in both variables, it is clear 
that <pi is concave on [0,1]. From the viscosity property of Vi in Theorem 14. 1\ and the 
change of variables (|5.3p . this implies that </? is the unique bounded viscosity solution to 
(|5.4p on [0, 1), satisfying the boundary condition (|5.5|) . Now, recalling that qu = — Ylj=a Qiji 
we observe that the system (|5.4|) can be written as: 



ip 



1 



_2\, J 



+ Xi -pbiz + -p(l -p)a { z )ipi- z(l -z)(pi - z(l -p)a i )ip i 



-^(l-zfafipl-il-p)^-^-^ 

z p 






(l-ZJijfipj^ — 



ZJij 



+ Xi sup ipi(n), z G (0, 1), i e I d . (5.12) 

7T6[0,1] 



Let us fix some i £ Id, and an arbitrary compact [a, b] C (0, 1). By standard results, see 
e.g. [3], we know that the second-order ODE: 



_2\„../ 



(p ~ Qu + Xi- pbiz + -p(l - p)a { z )wi - z(l - z)(bi - z(l - p)a { )w t 



-z 2 (l - zfafw'l - (l-p)(wi - -w'i 
2 p 



i-p 






(i-^Mf 1 



ZJij 



+ Xi sup pi(ir) 
7re[0,l] 



(5.13) 



has a unique viscosity solution Wi satisfying Wi{a) = ipi(a), Wi(b) = pi(b), and that this 
solution Wi is twice differentiable on [a, b] since the second term z(l — z)o~f is uniformly 
elliptic on [a, b], see [13]. Since <p>i is a viscosity solution to ()5.13[) by (|5.12|) . we deduce by 
uniqueness that ipi = Wi on [a, 6]. Since a, b are arbitrary, this means that ip is C 2 on (0, 1). 
By concavity of ipi, we have for all z € (0, 1), 

tpj(l) - tpj(z) < ,,. < ipj(z) - Pi(0) 
1 — z z 

Letting z — > and z — >• 1, and by continuity of pi, we obtain (|5.7p and (|5.9p . 
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Now letting z go to in (|5.4p . we obtain lim z _ > o-2 ¥>i( z ) = I f° r some finite I < 0. If 
Z < 0, z 2 (p'J(z) < 2 whenever z <rj, for some 77 > 0. By writing that 



and sending 2 — > 0, we get liminf^o 2^(2) > —1/2, which contradicts (|5.7p . Thus / = 0, 
and the boundary condition (|5.6[) follows by letting z^-Oin (|5.4p . In the same way, letting 
z — > 1 in (|5.4p and comparing with (|5.5p . we have 



\\m\{l- z)\'!{z) = (^(l)-^(l-))-^ £[0,00]. 
5,9p implies that this limit is 0, and we obtain (|5.10p and (|5.1ip . □ 



Remark 5.1 From (|5.3p and the above Proposition, we deduce that the value functions 
Vi, i G Id, are C 2 on (0, 00) x (0, 00), and so are solutions to the dynamic programming 
system (|4.2p on (0, 00) x (0, 00) in classical sense. I 

We now provide an explicit construction of the optimal investment /consumption strate- 
gies in feedback form in terms of the smooth solution tp to ()5.4j) - f|5.6j) - (j5.5[) . We start with 
the following Lemma. 

Lemma 5.1 For any i G 1^, let us define: 



c*(i,z) 



— ± 

(ipi(z) - ^(p'i(z)) 1_ * when < z < 1 

(^(O)) 1 ^ when z = 

when z = 1 



7r*(i) G arg max ipAiv). 
7T6[0,1] 

Then for each i G Id, c*{i,.) is continuous on [0,1], C 1 on (0,1), and given any initial 
conditions (r,z) G Id X R+ x [0, 1], i/iere exists a solution (Rt,Zt)t>o valued in M + x [0, 1] 
to the SDE: 

dR t = R t -Z t -(b It _dt + <7 It _dW t -'y It _ iIt dNt t -' It ^ - Rt-c*(I t -,Zt-)dt, (5.14) 

dZ t = Z t -(l- Z t - ) (bj - Z t - aj )dt + ar dW t ^ dN^~ M 

+ (7r*(/ t _) - Z t _)diV t + Z t c*(J t _, it_)dt. (5.15) 

Moreover, if r > 0, £/ien Rt > 0, a.s. /or all t > 0. 

Proof. First notice that Lemma 13.21 written in terms of the variables (r, z), is formulated 
equivalently as 

^(z)--^(z) > C2P- 1 (l- z y-\ ze(0,l). 
P 
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This implies that c*(i, .) is well-defined on (0, 1), and C 1 since cp is C 2 . The continuity of 
c*(i, .) at and 1 comes from (|5.7p and (|5.1ip . 

Let us show the existence of a solution Z to the SDE (J5.15P . We start by the existence 
of a solution for t < t\ (recall that (r n ) is the sequence of jump times of N). In the case 
where z = 1 (resp. z = 0), then Z t = 1 (resp. Z t = 0) is clearly a solution on [0, t\). 
Consider now the case where z € (0, 1). From the local Lipschitz property of z i-> zc*(i, z), 
and recalling that jij < 1, we know, adapting e.g. the result of Theorem 38, page 303 of 
|18j . that there exists a solution to 



dZ t = Z t - (1 - Z t - ) (6 V - Z t - aj ) dt + a v dW, ^ diV t 



+ Z t c*(I t _,i't-)<ft, (5-16) 

which is valued in [0, 1] up to time t < t[ := T\ A flim e ^ inf < t > 0|Z t (l — Z t ) < e>\. By 
noting that Zt > Z®, where 

z — 

Z? = -, ^ f>0 , 

,§ + (!-.)' " 

is the solution to (|5.16p without the consumption term, and since S is locally bounded away 
from 0, we have lim 4 _ > . r / Zt = 1 on {r{ < n}. By extending Zt = 1 on [t{,Ti), we obtain 
actually a solution on [0, ri). Then at T\, by taking Z T1 = 7r*(J T1 _), we obtain a solution 
to (J5.15P valued in [0, 1] on [0, n]. Next, we obtain similarly a solution to (|5.15p on [ri,T2] 
starting from Z Tl . Finally, since T n /* oo, a.s., by pasting we obtain a solution to (J5.15P for 
t 6K + . 

Given a solution Z to (|5.15p . the solution R to (|5.14p starting from r at time is 
determined by the stochastic exponential: 

Rt = r£UZ s - (b Is _ ds + a Is _ dW s - llg _ Js dN^ ,/s ) - c*(/ s _, Z s ^)dt\ . 

Since — Zt—Jj T > — 1, we see that Rt > 0, t > 0, whenever r > 0, while i? = if r = 0. 

a 

Proposition 5.2 Given some initial conditions (i,x,y) € Irfx(M^_\{(0,0)}) ; let us consider 
the pair of processes (C,c) defined by: 

Ct = Rt-(TT*(I t -) - Z t -) (5.17) 

c t = R t .c*(I t .,Z t .), (5.18) 

where the functions (c*,7r*) are defined in Lemma \5.1\ and (R,Z) are solutions to (|5.14|) - 
(|5.15p . starting from r = x + y, z = y/(x + y), with I starting from i. Then, (£, c) is an 
optimal investment/consumption strategy in Ai(x,y), with associated state process (X,Y) 
= (R(l-Z),RZ),forvi(x,y) = U{r) Vi {z). 
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Proof. For such choice of (C^), the dynamics of (R,Z) evolve according to ()2.10j) - ()2. 11[) 
with a feedback control (C, c), and thus correspond (via ito's formula) to a state process 
(X,Y) = (R(l - Z),RZ) governed by (pT2 >(|2~3]) . starting from (x,y), and satisfying the 
nonbankruptcy constraint (|2.5p . Thus, (£, c) G ^4j(rr,y). Moreover, since r = x + y > 0, 
this implies that i? > 0, and so (X, Y) lies in R\ \ {(0, 0)}. 

As in the proof of the standard verification theorem, we would like to apply Ito's formula 
to the function e~ pt v(X t , Y t , It) (denoting by v (x, y, i) = V{(x, y) = U(x + y)ifi(y/(x + y))). 
However this is not immediately possible since the process (Xt, Yt) may reach the boundary 
of R+ where the derivatives of v do not have classical sense. To overcome this problem, 
we approximate the function <pi (and so v(x,y,i)) as follows. We define, for every e > a 
function ip e = (y? £ )j e i d £ C 2 ([0, 1],M ) as in the proof of Theorem 4.24 in [6], such that 

• iff = tpi on [e, 1 -e], 

• iff — )• ifi uniformly on [0, 1] as e — > 0, 

• z(l — z)((pf)' — > z(l — z)ip' i uniformly on [0, 1] as e — > 0, 

• z 2 (\ - z) 2 (( / cf)" — > z 2 (\ - z) 2 cp" uniformly on [0, 1] as e ->■ 0, 

Now we can apply Dynkin's formula to the function v £ (x,y,i) = U{x + y)ip £ (y/(x + y)) 
calculated on the process (X,Y,I) between time and r n A T, where r n = inf{£ > : 
X t +Y t >n}: 



v e {x,y,i) 



E 



+ 



P(rnAT) qJ e t 

TnAT 



^v £ (X TnAT ,Y TnAT ,I TnAT ) 







P t l ™, E 



dv £ 



dv £ 1 



2 <>2 



P v + c*u- " br Y t - — - -ai_ Y t 



8h 



dx " J *-^ dy 2"'t- l dy 2 

- ^ g v ,K(x t -,y t -(i- 7v .),i)-^(x f -,y t -,j t -)] 

-A,_[i; e (X t - -Ct,^-+Ct,I t -)-^(^-,^-,^-)])^l (5.19) 



We denote by C(i,r,z) = r(7T*(z)— z), c(i,r,z) = rc*(i,z), and define g £ on (M+\{(0, 0)}) xl d 
by 

C/U^ Cj 1) II (71) II 



J2 Qij [v £ j{x, y(l - Jij)) - vf(x, y) 



A, 



vfl X 



C{i,x + y, — ■ — ),y + ((i,x + y, — ■ — 
x + y x + y 



v!(x,y) 



so that from (I5.19J) : 

v £ (i,x,y) 



E 



e- p( - TnAT) v £ (X TnAT ,Y Tn AT,Ir n AT) 

T„AT 



+ 



e-P t (U{c t )+g £ {X u Y u It))dt 



o 



Notice that the properties of (p £ imply : 



9i(x,y), 



(5.20) 
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vf = u i on{e< 5 ^<l-e}, 

vf — > Vi uniformly on bounded subsets of M? 



Qifi 



v 9vi 

q[i X -\- V — — ) X ^> 

' x+y> Q x ' uniformly on bounded subsets 

0, x = 



of: 



dy 



' — y>o 

dy ' uniformly on bounded subsets of R+ 



0. 



y = 



,d 2 v; 
dy 2 






»-io-' y >0 



<9y 2 



uniformly on bounded subsets of 



0. 



y = 



The details can be found in [7]. Since v is a classical solution of (|4.2p on (0, oo) x (0, oo), 
this implies that g e converges to uniformly on bounded subsets of R^_ when e goes to 0. 
We then obtain by letting e — > in (15, 20|) : 



v(x,y,i) 



E 



-p(r n AT) 



u (^t„AT, Y TnAT ,I TnAT ) + 



r„AT 



- pt U(c t )dt 



Prom the growth condition (|3.4p we get 



E 



-p(r n AT) 



V (^r n AT , Y Tn A T , I Tn AT ) 



< CE 



-p(r„AT) r>P 
e ""-TnAT 



So, using Lemma |3.1[ sending n to infinity, and then T to infinity, we get 



lim lim E 

T— >oo n— >-oo 



-"( T » AT '«(i T „ AT ,y T „Ar,^AT) 



o. 



Applying monotone convergence theorem to the second term in the r.h.s. of (|5.20p . we then 
obtain 



Vi(x,y) 

which proves the optimality of ((, c). 



E 



- pt U{c t )dt 



u 



5.2 Numerical analysis 

We focus on the numerical resolution of the system of ODEs (|5.4p - (|5.6p - (l5.5p satisfied by 
(<Pi)i<=i d , and rewritten for all i & Id, as: 



(p-qu + \i-pbiz + -p(l -p)a i z )<pi - z(l - z)(bi - z(l - p)a i )ip' i 

-^(i-«!'-(i-p)(^-^)^ 

z p 






0-hM^ 



+ Xi sup v?i(vr), z G (0,1), 

7re[0,l] 
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p ^ — ^ 

(p-qu + Kmw - (i -pmity 1 - p = V<?^j(o) + A, sup ^(71-), 

j# ^[0,1] 

(p - qu + Xi- pbi + -p(l - p)af)ifi(l) = V q i:j (l - 7^)^(1) + \ sup <Pi(ir). 

2 7^ -e[o,i] 

We shall adopt an iterative method to solve this system of integro-ODEs : starting with 
ip° = (ViOieid — Oj we solve ip n+1 = (y™ + )iei d as the (classical) solution to the local ODEs 
where the non local terms are calculated from ((/?") : 

(p - q u + A, - pb iZ + ip(l - p)*fz 2 )tf +1 - z(l - z)(bi - z{\ - p)*!)W +1 )' 

-\z\l - zfaM+r " (1 " PM +1 ~ Z -(^ +1 )T^ 






J \ 1 - ZJij 



P 

+ Aj sup <Pi(7r) 

7re[0,l] 



with boundary conditions 
(p-^ + A,)< +1 (0)-(l-pK +1 (0)-^ = J>^(0) + A, 



jV* 



sup (^"(vr), 

7rS[0,l] 



(p - q u + Xi- pb t + \p{\ - p)a 2 )^ + \l) = J2 ^C 1 " 7iiW(l) + *< sup ^(tt). 

2 ^ *e[o,i] 

Let us denote by: 

v n {xy) = iu(x + y)ipf^y ior(i,x,y)El d x(Rl\{(0,0)}) 

1 0, far* el* (x,y) = (0,0). 

A straightforward calculation shows that v n = (vf)i & i d are solutions to the iterative local 
PDEs: 



(ft - qu + Xi)v"l +l - b iy 



dv™ +l 1 2 2 d 2 v? +1 ^,dv? +: 

— - — — —a-v — 

dy 2 lii dy 2 



V S~lrr> ' 



dx 



J2QijVj(x,y(l-7ij)) + XiV^x + y), (x,y) G (0, oo) xl + , i el d , (5.21] 



together with the boundary condition (|3.8[) on {0} x (0, oo) for u$, i € 1^: 



<9e 



,n+l 



1 9 9 CTt> 



i2„.n+l 



(P - qu + A 4 )< +1 (0, .) - 6w-^-(0, •) - gofy ^ 
= J3gij«"(0,i/(l-7y)) + Ai-i)r(y), y > 0, » e I d . 

We then have the stochastic control representation for v n (and so for </? r 

Proposition 5.3 For all n > 0, we have 

r f 8n i 

<(x,y) = sup E / e-^Uic^dt , (i,x,y)el d xl 



-(o,.) 



(5.22) 



(C,c)6A(x,y) L J0 



■+> 



(5.23) 
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where the sequence of random times (6 n ) n >o are defined by induction from 6q = 0, and: 
e n+ i = inf [t > 6 n : AN t ^ or AN?" 1 * + o} , 
is the n-th time where we have either a change of regime or a trading time. 



i.e. 



First 



Proof. Denoting by w™(x,y) the r.h.s. of ()5.23|) . we need to show that wf = 

(with a similar proof to Proposition 14. 1[) we have the following Dynamic Programming 

Principle for the w n : for each finite stopping time r, 



< + \x,y) 



sup E 



-A0i 



e- pt U{c t )dt + l {T >e l} e- ptil wl (X ei ,Y 01 ) 



+l {T<ei} e-^wl +1 



(X T , Y T 



(5.24) 



The only difference with the statement of Proposition 14. II is the fact that when r > 9\, we 
substitute w n+l with w n since there are only n stopping times remaining before consump- 
tion is stopped due to the finiteness of the horizon in the definition of w n . 

By using ()5.24p , we can show as in Theorem 14.11 that w n is the unique viscosity solution 
to ()5.2ip . satisfying boundary condition (|5.22p and growth condition (|3.4p (it is actually 
easier since there are only local terms in this case). Since we already know that v n is such 
a solution, it follows that w n = v n . □ 

As a consequence, we obtain the following convergence result for the sequence (v n ) n . 

Proposition 5.4 The sequence (v n ) n converges increasingly to v, and there exists some 
positive constants C and 5 < 1 s.t. 



< Vi - v? < C5 n (x + y) p , V(i, x, y)el d x M. 2 + 
Proof. First let us show that 



sup 

(c, C) e Ai(x,y) 

{(x,y) £M 2 + : x + y = 1} 



E 



e-^Rl 



< 1. 



(5.25) 



(5.26) 



By writing that e~ pt R p = DtLt, where (Lt)t = {e~ ^ p ' t R p )t is a nonnegative supermartingale 
by Lemma |3. 11 and (-Dj)t = ( y e~^ p ~ k ^ p >' t )t is a decreasing process, we see that (e~ pt R P )t is 
also a nonnegative supermartingale for all (£>c) G Ai(x,y), and so: 



E 



-pe 1RP 



< E 
= E 



- P (e 1 Ai) R p 



lAl 



" -(p-k(p))(tflAl) -fc(p)(*iAl)nP 

e e ^iAI 

e -k(p)(6iAi) R p] < ! for all (£ )C ) G ^(^y) W ith 

e property of (e~ k ^ t R P )t), and by using also the 
uniform integrability of the family le~^- p ^ lAl 'Rg A1 ) from Lemma |3. 11 we obtain the 
relation (f5T26l) . 



Now, since e -{p~KpWiM) < j as ; E 
a; + y = 1 (recall the supermartinga 
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The nondecreasing property of the sequence (v™) n follows immediately from the rep- 
resentation (|5.23p . and we have: vf < t>™ + < v for all n > 0. Moreover, the dynamic 
programming principle (|5.24p applied to r = Q\ gives 



v'1 +1 (x,y) = sup E 



f 1 e-P'U^dt + e-P^ (X ei ,Y 9i : 
Jo &1 



(5.27) 



Let us show (|5.25p by induction on n. The case n = is simply the growth condition (|3.4p 
since v° = 0. Assume now that (J5.25P holds true at step n. From the dynamic programming 
principle (|4.1[) and (|5.27p for v and v n+1 , we then have: 

v1 + \x, y) > Vi(x, y) - sup E L-P 01 (v Ie - vf ) (X 0l , Y 9l ] 

(C,c)eAi{x,y) L 

> Vi(x,y)- sup E\e~ pei C5 n R p 9i 
= Vl ( x ,y)-C5 n+1 {x + yr, 

by definition of 5. This proves the required inequality at step n + 1, and ends the proof. □ 

In the next section, we solve the local ODEs for (p n with Newton's method by a finite- 
difference scheme (see section 3.2 in [12J). 

5.3 Numerical illustrations 

5.3.1 Single-regime case 

In this paragraph, we consider the case where there is only one regime (d = 1). In this case, 
our model is similar to the one studied in [17], with the key difference that in their model, 
the investor only observes the stock price at the trading times, so that the consumption 
process is piecewise-deterministic. We want to compare our results with |17| . and take the 
same values for our parameters : p = 0.5, p = 0.2, b = 0.4, a = 1. 

Let us recall from |17] the reason behind this choice of parameters (which are not very 
realistic for a typical financial asset) : to allow meaningful comparison to the Merton (liquid) 
problem, the optimal Merton investment proportion should be in [0,1], while the liquid 
value function vm should be significantly higher than the value function vq corresponding 
to the consumption problem without trading. These two constraints correspond to a high 
risk-return market. In the next subsection (multi-regime case), the choice of parameters 
will also follow from this reasoning. 

Defining the cost of liquidity P(x) as the extra amount needed to have the same utility 
as in the Merton case : v(x + P(x)) = vm(x), we compare the results in our model and in 
the discrete observation model in [T7]. The results in Table 1 indicate that the impact of 
the lack of continuous observation is quite large, and more important than the constraint 
of only being able to trade at discrete times. 

In Figure 1 we have plotted the graph of <p(z) (actually f n [z) for n large) and of the 
optimal consumption rate c*(z) for different values of A. Notice how the value function, 
the optimal proportion and the optimal consumption rate converge to the Merton values 
when A increases. 

23 



A 


Discrete observation 


Continuous observation 


1 
5 
40 


0.275 
0.121 
0.054 


0.153 
0.016 
0.001 



Table 1: Cost of liquidity P(l) as a function of A. 

We observe that the optimal investment proportion is increasing with A. When z is 
close to 1 i.e. the cash proportion in the portfolio is small, the investor faces the risk 
of "having nothing more to consume" and the further away the next trading date is the 
smaller the consumption rate should be, i.e. c* is increasing in A. When z is far from 1 
it is the opposite : when A is smaller the investor will not be able to invest optimally to 
maximize future income and should consume more quickly. 
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Figure 1: 

Value function tp(z) (left) and optimal consumption rate c* (2) (right) for different values of A 



5.3.2 Two regimes 

In this paragraph, we consider the case of d = 2 regimes. We assume that the asset price 
is continuous, i.e. 712 = 721 = 0. In this case, the value functions and optimal strategies 
for the continuous trading (Merton) problem are explicit, see [20] : v^m(t) = *r<Pi,M where 
(^i,M)i=i,2 is the only positive solution to the equations: 



P-Qi 



bfp 



<Pi,M - (1 - P)<Pi.M 



2a 2 (l -p)J r vr'j.Af QijVj,Mi 



i,j 6 {1,2}, i^j. 



The optimal proportion invested in the asset tt? m = ( ,_\ 1 is the same as in the single- 

_i 
regime case, and the optimal consumption rate is c* M = (<^j,m) p ■ We take for values of 
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the parameters 



p = 


= 0.5, 




<?12 = 921 = 


= 1, 




h=b 2 ~- 


= 0.4, 




CJl = 1, 


0"2 = 


= 2 



i.e. the difference between the two market regimes is the volatility of the asset. In Figure 
[2j we plot the value function and optimal consumption for each of the two regimes in this 
market, for various values of the liquidity parameters (Ai, A2). As in the single-regime case, 
when the liquidity increases, 93 and c* converge to the Merton value. 

Note that while in the single regime-case the optimal investment proportion is usually 
increasing with the liquidity parameter A, in the presence of several regimes there does not 
appear to be a simple similar effect, as can be seen for instance in the upper-right panel of 
Figure [2j 

To quantify the impact of regime-switching on the investor, it is also interesting to 
compare the cost of liquidity with the single-regime case, see Tables [2] and [3j We observe 
that, for equivalent trading intensity, the cost of liquidity is higher in the regime-switching 
case. This is economically intuitive : in each regime the optimal investment proportion is 
different, so that the investor needs to rebalance his portfolio more often (at every change 
of regime) . 

6 Conclusion 

In this paper we proposed a simple model of an illiquid market with regime-switching, in 
which the investor may only trade at discrete times corresponding to the arrival times of 
a Cox process. In this context, we studied an investment/consumption problem over an 
infinite horizon. In the general case, we proved that the value function for this problem is 
characterized as the unique viscosity solution to the HJB equation (which is a system of 
integro-PDEs). In the case of power utility, we proved the regularity of our value function 
and we were able to characterize the optimal policies. Finally we have presented some 
numerical results in this special case. 

With some straightforward modifications, our viscosity results could be extended to 
more general regime-switching diffusions (assuming e.g. Lipschitz coefficients). However, 
the dimension reduction in the case of power utility which allowed us to prove regularity, 
and made the numerical resolution easier, is specific to our (regime-switching) Black Scholes 
dynamics. 
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(Ai,A 2 ) 


A(l) 


ft(l) 


(1,1) 

(5,5) 
(10,10) 


0.257 
0.112 
0.069 


0.224 
0.103 
0.064 



Table 2: Cost of liquidity Pi(l) as a 
function of (Ai, A2). 



A 


A(l) 


^(1) 


1 
5 
10 


0.153 
0.015 
0.004 


0.087 
0.042 
0.024 



Table 3: Cost of liquidity Pi(l) for the 
single-regime case. 






* — 




(Ai,A 2 ) = (l,l) 

(Ai,A 2 ) = (10,l) 



(Ai,A 2 ) = (l,10 

(Ax,A 2 ) = (10,10 
Merton 



Figure 2: ipi and c* for different values of (Ai,A 2 ) 
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Appendix A: Dynamic Programming Principle 

We introduce the weak formulation of the control problem. 

Definition A.l Given (i,x,y) € Irf x M + x R + , a control U is a 9-tuple 
(n,T,F,W = (F t ) t >o,W,I,N,c,(), where : 

1. (0,,J-,F,¥) is a filtered probability space satisfying the usual conditions. 

2. I is a Markov chain with space state 1^ and generator Q, Iq = i a.s., N is a Cox 
process with intensity (\i t ), and W is an F-Brownian motion independent of (I,N). 

3. Tt = cr(W s , I s ,N s ;s<t)\/ J\f , where W is the collection of all F-null sets of T . 

4- (ct) is ¥ -progressively measurable, (Q) is ¥ -predictable. 

We say that'll is admissible, (writing U € Af(x,y)), if the solution (X,Y) to (|2.3p - (l2.2p 
with Xq = x, Yq = y, satisfies X t > 0, Y t > a.s. 

Given U € Af(x, y), define JiU) = E [f^° e~ ps U(c s )ds\ , and the value function 

Vi(x,y) = sup JiU). 

U£A™(x,y) 



Proposition A.l For every finite stopping time r and initial conditions i,x,y, 



Vi(x,y) = sup E 

{Z,c)eAy(x, y ) 



i e~ pt U(c t )dt + e~ pT v lr (Xt, Y t ) 
Jo 



(A.l) 



Before proving this proposition we state some technical lemmas. 



Lemma A.l Given (£1, J-, P, F = (J-t), W, I, N) satisfying the conditions of Definition XA.K 
define F° = (J r j ) )t>o, where if = a(W s , I s , N s ; s < t). Then if (q) is ¥ -progressively mea- 
surable (resp. predictable), there exists c\ F° -progressively measurable (resp. predictable) 
such that c = c\ dP (g) dt a.e.. 

Proof. We only give a sketch as the arguments is standard. We first use Lemma 3.2.4 page 
133 in [11] to find, for each n G N, an approximating J-^-simple process c n converging to c 
in the L (dt <S> dF) norm. Then, using Lemma 1.25 page 13 in [10], we can change every 
c n on a null-set and find a sequence of TV -simple process c"(t) that again converges to c 
in the L 2 (dt dF) norm. We now extract a subsequence (denoted again by c") such that 
cl —> c a.e. and we define c\ := lim infn^+oo c™. This is J- s ' -progressively measurable and 
c = ci, dt dF a.e. on [0, +oo) x fi. This concludes the proof. □ 

Remark A.l With the notations of the previous lemma, it is easy to check that (X c ^ , Y c ^ ) 
~ (X c, \ Y c ^) in law. Hence without loss of generality we can assume that c is F°- 
progressively measurable and £ is F°-predictable. I 
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Define W as the space of continuous functions on M + , X the space of cadlag Id-valued 
functions, M the space of nondecreasing cadlag N-valued functions. On W x X x AT, define 
the filtration (Bt)t>o, where B® is the smallest a-algebra making the coordinate mappings 
for s < t measurable, and define B® + = f) s>t B®. 

Lemma A. 2 If c is F° -progressively measurable (resp. F° -predictable) , there exists a £>£+- 
progressively measurable (resp. B® -predictable) process f c : R + xWxXxA/"— > M., such 
that 

ct = fc(t, W. M , /. At , N. M ), for P - a.e u, for all t G E+ 



Proof. For the progressively measurable part one can see e.g. Theorem 2.10 in [22]. For c 
predictable, notice that this is true if c = Xlu s -\, where X is J^-measurable, and conclude 
with a monotone class argument. □ 



Proof of Proposition A.l. Let V%(x, y) be the right hand side of (lA.ip . 
Step 1. V{(x,y) < Vi(x,y): Take U G Af(x,y). Then 



E 



/ e- pt U{c t )dt\T T = / e- pt U{c t )dt + e~ pT E / e- ps U(c T+s )ds \F T 
Jo J Jo Uo 



(A.2) 



By Remark IA.ll w.l.o.g. we can assume that c is F°-progressively measurable (resp. £ 
F°-predictable). For u € O, define the shifted control U"° = (n,F T ,F Uo , ?!,}¥, I, N,c,(), 
where : 

• P a;o =P(.|Jv)(a;o) 

• W t = W T+t - W T 

• I t = I T +t 

. N' t = N T+t - N T 

• F T is the augmentation of T by the P wo -null sets, and J-[ is the augmented filtration 
generated by (W,I,N). 



c t = ct+r, Ct = C 



t+T 



Then we can check that for almost all ujq, U^ satisfies the conditions of Definition IA.1I 
(with initial conditions (I t (loo),X t (loo),Y t (u!q))) : 2. comes from the independence of W 
and (I, N) and the strong Markov property, and 4. is verified because for almost all luq 

Moreover, there is a modification (X',Y') of (X, Y) s.t. (X' T+t ,Yj. +t ) is F r -adapted, 
and a solution of (J23]) -([2T2 ]) for (W,I,N). Hence W° G Af Aulo) (X T (uJo),Y T (uj )), and 



E 



e- ps U(c T+s )ds \? T 



(w ) = J{ir o ) <v Ir (X T ,Y T )(cj ). 
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Hence taking the expectation over ujq in (IA.2I) . 



E 



- pt U(ct)dt 



< E 



e~ pt U(c t )dt + e- pT v lT (X T , Y T ) 



and taking the supremum over U, we obtain Vi(x, y) < Vi(x, y). 



Step 2. Vi(x,y) > Vi(x,y): Recall that in the proof of Proposition 13.21 we only needed the 
DPP to prove the continuity of v\ up to the boundary. Hence we know a priori that Vi is 
continuous on Int(M.+ ), and that the restriction of Vi to the boundary is continuous. One 
can then find a countable sequence (Uk)k>o s.t. 

(i) (Uk)k is a partition of M+, 
(ii) V(x,y),(x',y') <E U k ,Vi,\vi(x,y) -Vi(x',y')\ < e, 

(iii) Uk contains its bottom-left corner (xk,yk) = ( m i n (x,y)eC/ fc x i Tn ^ Il (x,y)eUk V)- 

Indeed, we can construct such a partition in the following way: Vi is continuous on the 
boundary so we can partition each of the boundary lines into a countable number of seg- 
ments verifying (ii) and (iii). Then in the interior we have first a partition in "squared 
rings" : Int(M%) = U n >iK n , where K n = [l/(n + 1), n + l] 2 \ [1/n, n] 2 . Since Vi is continu- 
ous on the interior, we can partition each K n into a finite number of squares verifying (ii) 
and (iii). By taking the union of the line segments and the squares for each K n , we obtain 
a sequence (Uj.) satisfying (i)-(iii). 

Notice that (iii) implies the inclusion Ai(xk,yk) C Ai(x, y), for all (x, y) € U k - For 
each k, take U l ' k = (Qh k ^h k ^f> t , k j Y l ' k ,W hk ,I hk ,N hk ,c l ' k ,C' k ) ^-optimal for (i,x k ,y k ), 
and fc , fp associated to (c t,k , (, t,k ) by Lemma lA. 21 Then for each (c, Q £ A%(x,y), let us 
define c, C by : 



Q 



Ct 



when t < r 



pi,k 



/r(t - r, W(. A (t - r)), /(. A (t - t)),N(. A (t - r))) when t>r,I r = i, (X T , Y T ) € U k . 



Then c (resp. £) is F- progressively measurable (resp. predictable). Furthermore, for almost 
all wq, with i = I t (ujq) and (X t ,Y t )(ujo) £ Uk, 



£f-o (W, I, iV, (c t+T ), (Ct+r)) = A-,* (H^ fe , P> k , N l > k , <?>*, c k ), 

and since Ai{x k ,yk) C ^/ T ( aJo )(X T (w ),y T (wo)), this implies X i c ' C ,y i c ' C > a.s., and (c, C) G 
«4i(x,y). We also have 



E 



e- ps U(c T+s )ds \F T 



(<*>o) 



E 



i k 



e- ps U{cy k )ds 



> Vi(x k ,yk)-£ 

> v u (X r ,Y T )(uj )-2e. 



By taking expectation in (|A.2p . we have 



E 



~ pt U{c t )dt 



> E 



e~ pt U(c t )dt + e- pT v lT (X T ,Y T ) 



2e. 
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Finally, by taking the supremum over U, and letting e go to 0, we obtain Vi(x, y) > Vi(x, y). 

a 

Remark A. 2 Actually the weak value function is equal to the value function defined in 
flUlD for any (O, J\P,F, W, I, N) satisfying (l)-(3) in Definition Ell Indeed, given any 
W = (0' 5 T', P', ¥', W, I', N') G Af(x, y), letting f d and f c being associated to d and (' by 
Lemmas lA.ll and [A.2( and defining (almost surely) Ct = f c >(t,W,I,N), (t = f('(t,W,I,N), 
by the same arguments as in the Proof of Proposition lA.il U := (fl, J-, P, F, W, I, N, c, £) G 
Af(x,y), and J{U) = J(W). Hence 



sup J{W) = sup E 

W'€.A™(x,y) (c,C)6A(x,y) 



e- ps U(c a )ds 



Appendix B: Viscosity characterization 

We first prove the viscosity property of the value function to its dynamic programming 
system (|4.2|) . written as: 



Fi(x,y,Vi(x,y),Dvi(x,y),D 2 Vi(x,y)) +Gi(x,y,v) = 0, (x, y) G (0, oo) x K + , 
for any i G 1^, where i^ is the local operator defined by: 

Fi(x,y,u,p,A) = pu-biyp 2 - -afy 2 a 22 -U{pi) 

for (x,y) G (0, oo) x R+, « G E, p = (pi p 2 ) G K 2 , A = f Ql1 ° 12 J G <S 2 (the set of 

y aii a 2 2 J 

symmetric 2x2 matrices), and Gj is the nonlocal operator defined by: 

Gi(x,y,w) = -Y^qij[wj(x,y(l-jij))-Wi(x,y)] - \i[wi(x + y) - Wi(x , y)] 

for w = (wi)i£i d (i-tuple of continuous functions on R^_. 

Proposition B.l The value function v = (v i)jgi d is a viscosity solution of (E). 

Proof. Viscosity supersolution: Let (i,x,y) G Id X (0, oo) x ]R + , 99 = (yi)igi d , C 2 test 
functions s.t. Vi(x,y) = ipi(x,y), and v > ip. Take some arbitrary e G (—y,x), and c G M+. 
Since 5 > 0, there exists a strictly positive stopping time r > a.s. such that the control 
process (£, c) defined by: 

Ct = el t < T , c t = clt< T , t > 0, (B.l) 

with associated state process (X, Y, I) starting from (x, y, i) at time 0, satisfies Xt > 0, 
Yt > 0) f° r au t. Thus, (Cjc) G ^j(a;,y). Let V be a compact neighbourhood of (x,y,i) 
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in (0,oo) x M + x Id, and consider the sequence of stopping time: 9 n = 9 A h n , where 
6 = inf {t > : (X t ,Y t ,It) ^ V}, and (h n ) is a strictly positive sequence converging to 
zero. From the dynamic programming principle (|4.ip . and by applying Ito's formula to 
e~ pt (p(Xt,Yt,It) between and 6 n , we get: 



<p(x,y,i) = v(x,y,i) > E 

> E 



e^U(c t )dt + e-P^v{X enl Y en1 Ie n ) 



e~'*U(ct)to + e-'»»<p{X enl Yo n) Io n 



<p(x,y,i)+E I e- pt (U(c t )-p<p-ct^f 



dx 

f " '■ * t~ J t 

+A 7 _ [p(X t - - &, Y t - + 0, h- ) - ¥>(**- , %- , I t _ )] ) dt 



and so 



E 



-p' 



PV-U(c t ) + c t —-b It _Y t 



dip 1 2 - 2 5V 



- 2 g v .KX t -,Y t -(l-7 v .),i)- ¥? (X t - ) y t -,I t -)] 

-\ h _[p{X t - -( t ,Y t -+( t ,I t -)-<p(X t -,Y t -,I t -)]yt\ > (B.2) 
Now, we have almost surely for n large enough, 9 > h n , i.e. 9 n = h n , so that by using also 

dH3D 



1 



*Z-K-%- d -&.-\°ly?--, 



h n J V rr ~ y ~-''~*dx " J '~^ dy 2 Jl t- It ~dy 2 

■ J2 Qr MXt-,Y t -(l-Jr j ),j)-^p{X t - 1 Y t -J t -)\ 
-A 7 _ [^(X t - - Ct, Y*- + Ct, h- ) ~ <p{Xt- , Yt- , h- )] ) dt 



dipi 



-d<fi 



1 2 -2 d2 fi 



— > Pfi(x,y)-U(c)+c—(x,y)-b i y—(x,y)--a i y -^(x^y) 

-^Qiji^j^^yi 1 -Hj)) -tPi(x,v)] ~ h[Vi{x -e,y + e)- tfi(x,y)], a.s. 

when n goes to infinity. Moreover, since the integrand of the Lebesgue integral term in 
(|B.2|) is bounded for t < 9, one can apply the dominated convergence theorem in (|B.2p . 
which gives: 

p<Pi(x,y) -U(c) + c-^(x,y) -hy-^{x,y) - -afy 2 -^-(x,y) 
-^Qij[^j{x,y{^-lij)) -^i(x,y)}- Xi[ifi{x-e,y + e) -ifi{x,y)} > 0. 
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Since c and e are arbitrary, we obtain the required viscosity supersolution inequality by 
taking the supremum over c € M+ and e € (—y,x). 

Viscosity subsolution: Let (i,x,y) G Id x (0, oo) x R + , 99 = (y>t)tei d , C 2 test functions s.t. 
v(x,y,i) = tp(x,y,i), and v < ip. We can also assume w.l.o.g. that v < tp outside (x,y,i). 
We argue by contradiction by assuming that 



-P<Pi 



1 2-2 5 Vi, 



^7 






> 0. 



By continuity of <p, and of its derivatives, there exist some compact neighbourhood V of 
(x, y, i) in (0, 00) x K + x JLj, and e > 0, such that 



W(x,y) - hy-^^y) ~ 2^V^(^,y) - u{-^{x,y) 



(B.3) 



Since v < ip outside (x,y, i), there exists some (5 > s.t. u < 99 — 5 outside of V. We can 
also assume that e < 5p. By the DPP (|4.1|) . there exists (C,c) € .Aj(a;,y) s.t. 



_ _ - 1 - e" p 

v(x,y,i)-e — < E 

2p 



0A1 



-p(0Al) 



e^U^dt + e-^ A1 >v(X eA1 ,Y eA1 ,I eAl ] 



where (X.Y,!') is controlled by (C,c), and we take 6 = inf {t > : (X t ,y t ,I t ) ^ V}. We 
then get: 



<p(x,V,i) -e 



v(x,y,i) -e 



1-e-P 
2p 



< E 



0A1 



e-<*U(ct)dt + e-^ A1 V(^Ai,y>Ai, W - e _p ^l{e<i} 



(f(x,y,i) + E 



0A1 



-P' 



C/(q ) - p<p-ct 



dip 



dx 

2 v 2 



^ + 1^2 y2 ^V 

9y t 2 J «" i_ dy 2 



+ ^- y *-^ +o<-^- 



+ E 9 VJ [^(^-,^-(i-7 VJ ),i)-^^-,yt-,v)] 

+A V [p{X t - - ( t , Y t - + (t, h- ) - ¥>(**- , Yt- , h- )])dt- e-*6l {0<1 

I-6A1 



< <p(x,y,i)+M 



/•tfAl 

/ -ee- pt dt - e- pe 51 {e<1} 
Jo 
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where we applied Ito's formula in the second equality, and used (JB.3P in the last inequality. 
This means that 



1-e'P 

-e < E 



2p 



e/\i 



-ee- pt dt - e- pe 5h 



XI} 



E 



± + l e - P (0Ai)_ e - P e sl 
P P 



P 



since e/p < 6, and we get the required contradiction. 



□ 



Let us now prove comparison principle for our dynamic programming system. As usual, 
it is convenient to formulate an equivalent definition for viscosity solutions to (|4.2p in terms 
of semi-jets. We shall use the notation X = (x, y) for M+ x R+-valued vectors. Given w 
= (wi)i£i d a d-tuple of continuous functions on R+, the second-order superjet of Wi at X € 
M+ is defined by: 

V 2 ' + Wi(X) = Up, A) eM 2 xS 2 s.t. Wi(X') < Wi(X) + (p,X' - X) 

+ \{A{X' -X),X' -X) +o(\X'-X\ 2 ) asX'^ll, 

and its closure V ' Wi(X) as the set of elements (p,A) £ I 2 x 5 2 for which there ex- 
ists a sequence (X m ,p m ,A m ) m of M+ x V 2 ' + Wi(X m ) satisfying (X m ,p m ,A m ) -)• (X,p,A). 
We also define the second-order subjet T 2 ~Wi(X) = —V 2,+ (—Wi)(X), and V ' wdX) = 

2 + 

— V ' (—Wi)(X). By standard arguments (see e.g. [2] for equations with nonlocal terms), 
one has an equivalent definition of viscosity solutions in terms of semijets: 

A d-tuple w = (wi)i£i d of continuous functions on M^_ is a viscosity supersolution (resp. 
subsolution) of (|4.2|) if and only if for all (i,x,y) € I<j x (0, oo) x E + , and all (p,A) € 
V ' Wi(x,y) (resp. V ' Wi(x,y)): 

Fi(x,y,Wi(x,y),p,A) + Gi(x,y,w) > 0, (resp. < 0). 
We then prove the following comparison theorem. 

Theorem B.l Let V = (Vi)i£i d (resp. W = (Wi)i^i d ) be a viscosity subsolution (resp. 
supersolution) of ()4.2|) . satisfying the growth condition ()3.4[) . and the boundary conditions 



Vi(0,0) < 
Vi(0,y) < Ej 



Sr 

Sq 



V - (y^ 
^ {y S< 



Vy>0, 



(B.4) 
(B.5) 



(resp. > for W). Then V < W. 



Proof. Step 1: Take p' > p such that k(p') < p, and define tpi(x,y) = (x + y) p , i G 1^. 
Let us check that W n = W + ^ip is still a supersolution of (E). Notice that V 2 ~W[ 1 ' = 
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V 2 '~Wi + ±(DiPi,D 2 7Pi), and we have for all (p,A) £ V 2 '~Wi(x,y): 

1_ , 1 



F i (x,y,W[ l (x,y),p+-D4; u A + -D 2 i> i )+G i (x,y,W r ' 



n n 

Fi (x, y, Wi(x, y),p, A) + G t (x, y, W) 

.2 / „, \ 2 



n V :r + y 2 \x + y J *-?. J x + y 

+ t/(pi)-C/(pi + -pV'- 1 ) (B.6) 



n 
> 0. 



Indeed, the three lines in the r.h.s. of (|B.6[) are nonnegative: the first one since W is a 
supersolution, the second one by k(p') < p, and the last one since U is nonincreasing. 

Moreover, by the growth condition (13.4J) on V^ and W, we have: 



limmax(y ! -^)(r) = -oo. (B.7) 

In the next step, our aim is to show that for all n > 1, V < VK n , which would imply that 

V < W. We shall argue by contradiction. 

Step 2: Assume that there exists some n > 1 s.t. 

M := sup (V r i-W7 , )(x,|/)>0. 

ien d ,(x,j/)GR2_ 

By (|B.7p . there exists i Eld, some compact subset C of R+, and X = (x,y) £ C such that 

M = max(Vi-W?) = (Vi-W?){x,y). (B.8) 

Note that by (|B.4|) . (x,y) / (0,0). We then have two possible cases: 

• Case 1 : x = 0. Notice that the boundary condition (|B.5|) implies the viscosity subsolution 
property for VJ also at X = (0,y): 

F i (A > ,K(X),p,A) + G l (X,y) < 0, V(p,A)GP 2 'V i (X) 

However the viscosity supersolution property fot W n does not hold at (0,y). Let (Xk)k = 
{ x k:Uk)k be a sequence converging to X, with Xk > 0, and e k := |Xfc — X|. We then 
consider the function 



$ k (x,x') = v i (x)-w l n (x')-Mx,x'), 

\X — X'\ 2 { x' 

ipk{x,y,x',y') = x A + {y-y) 4 H hi 1 

2£fc \Xk 

Since <!>& is continuous, there exists (Xk,X' k ) G C 2 s.t. 

M k :=sup<f> k = <I> k {X k ,X' k ), 
C 2 
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and a subsequence, still denoted (X k ,X' k ), converging to some (X,X') as k goes to oo. By 
writing that $ k (X,X k ) < $ k (X k ,X k ), we have : 



Vi(X) - W?(X k 



\x — x k \ 



< ViiXj-WTiXti-ixi + iyk-yfi-Rk 

< Vi (X k )-Wr(X' k )-(xi + (y k -y)% 



(B.9) 

(B.10) 
(B.ll) 



where we set 



Ri 



X k -XL 



2e k 



+ 



x' 



■i'k 



Since Vi and WJ 1 are bounded on C, we deduce by inequality (jB.lOp the boundedness of 
the sequence (R k ) k >o, which implies X = X'. Then by sending k to infinity in (|B.9p and 
(IBTTT) . with the continuity of V t and W t n , we obtain M = Vi(X) - W?(X) < Vi(X) - 
W™(X) — (xj, + (y k — y) ), and by definition of M this shows 



X = X' = X 



(B.12) 



Sending again k to infinity in ([BT9|) - (|B~1Q1) - ([B~TT]) . we obtain M < M - limsup fc R k < M, 
and so 



X k -X' k 



2e k 



+ 



1 



Xk 



0, 



(B.13) 



as k goes to infinity. In particular for k large enough x' k > ^ > 0. We can then apply 
Ishii's lemma (see Theorem 3.2 in [3]) to obtain A, A' G S 2 s.t. 



(p,A) e V Z ' + V t (X k ), (p',A>) g P A W?(X' k 



A 



< D + e k D 2 



V o -A' 

where 

p = D x i/> k (X k ,X'k), P' = D x ,il> k {X k ,X' k ), D = D x<x 4 k (X k ,X' k ). 

Now, we write 

pM < P M k < p(Vi(X k ) - WT(X' k )) 

= Fi(X k ,Vi(X k ), P ,A) - Fi{X kt WP(X' k ),p,A) 
= Fi(X k ,Vi(X k ),p,A)+Gi(X k ,V) 

-F t {X' k ,wnx' k ),p',A') -G t (X' k ,W n ) 

+ Gi(X' k ,W n ) - Gi(X k ,V) 

+ F i (XL,wr(Xj e ),i/,A , )-F i (X k ,W?(X' k ),p,A) 



(B.14) 
(B.15) 



(B.16) 
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From the viscosity subsolution property for V at X k , and the viscosity supersolution prop- 
erty for W n at XL, the first two lines in the r.h.s. of (]B.16P are nonpositive. For the third 
line, by sending k to infinity, we have: 

Gi(X' k ,W n ) - Gi(X k ,V) 

-> G l (X,W n )-G t (X,V) 

= E%[(^-wT)(^y(i-7u)) -(Vi-w?)(x,v) 

+\\{Vi - Wr)(x + y) - (V t - W?){x,y) 

< o 

by ()B.8p . For the fourth line of (|B.16p . we have 

F i {X' k ,W?{X' k ),p , ,A)-F i {X k ,W?{X' k ),p,A) 

a? 



Now 



k(y k P2 - y' kP ' 2 ) + Ufa) - Ufa) + -f (fe 2 - (&)V 22 ) 



A( ~ -n3 , Vk-y' k \ ~< (vk-y'k 

VkP2 ~ y k P2 = Vk 4(jfc - y) + )-Vk 



< 4y fc (y fc -y) 3 + 
— > 0, as k — > oo, 
by (fB~l~2l) and (JBTl~3l) . Moreover, 



~A- 



X k - x' k 



£k 



£k 



Ufa) - Ufa] 



u 



°^^*+4xl) 



£k 



X k — X k 6 / X, 



&k ^k \^k 



< o, 

since U is nonincreasing. Finally, 



yt a 22 - (y' k ) 2 a 



22 



y k y' k 



A 
-A 



< ( y k y' k ){D + e k D 2 ) 



( o \ 

m 

o 

w/ 

' o \ 

yk 
o 

\y'k ) 



by (IBTT51) . Since 



D 2 if) k (x,y,x',y') 



( \1x 7 







12(y-y) 2 + ^ 




j_ 



V ° 






_J_ 



i + ^c-El-l 





o \ 
_J_ 
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a direct calculation gives 



y k y' k )(D + e k D 2 ) 



( o \ 

o 

\y' k J 



T7\2„-. .V 



£fc 



(#Jfe - 2/fc) - 12 <J/fc - J/) VkVk 



+ (36(y fc - y) 2 + e k (12(& - y) 2 )) y 2 
— >• 0, as fc — > oo, 



where we used again (jB.12[) and (|B.13[) . and the boundedness of (jjk,y'i 



Finally by letting k go to infinity in (JB.16P we obtain pM < 0, which is the required 
contradiction. 



• Case 2 : x > 0. This is the easier case, and we can obtain a contradiction similarly as in 
the first case, by considering for instance the function 



* k (X,X') = V l (X)-W l n (X')-(x-x) 4 -(y-y) A -k 



\X-X'\ 



□ 
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